High quality 3D reconstruction based on fusion of polarization imaging and binocular stereo vision

Polarization imaging can retrieve inaccurate objects’ 3D shapes with fine textures, whereas coarse but accurate depths can be provided by binocular stereo vision. To take full advantage of these two complementary techniques, we investigate a novel 3D reconstruction method based on the fusion of polarization imaging and binocular stereo vision for high quality 3D reconstruction. We first generate the polarization surface by correcting the azimuth angle errors on the basis of registered binocular depth, to solve the azimuthal ambiguity in the polarization imaging. Then we propose a joint 3D reconstruction model for depth fusion, including a data fitting term and a robust low-rank matrix factorization constraint. The former is to transfer textures from the polarization surface to the fused depth by assuming their relationship linear, whereas the latter is to utilize the low-frequency part of binocular depth to improve the accuracy of the fused depth considering the influences of missing-entries and outliers. To solve the optimization problem in the proposed model, we adopt an efficient solution based on the alternating direction method of multipliers. Extensive experiments have been conducted to demonstrate the efficiency of the proposed method in comparison with state-of-the-art methods and to exhibit its wide application prospects in 3D reconstruction.     

基于机器视觉的轮胎表面缺陷检测系统的研究与应用

在传统的轮胎表面缺陷依靠人工检测,存在劳动强度高、受人的主观影响大以及效率低下的问题。针对这一现象,研究了一种基于机器视觉的轮胎表面缺陷3D检测系统。该系统依靠机器视觉系统获取检测轮胎的表面图像,然后创建3D模型、判定缺陷类型,最终实现实时自动预警,为轮胎生产商提供一种自动化检测方案。系统集成了先进的技术、软件和工具,配套的信息管控系统可以对轮胎型号和生产数据进行采集、存储、分析,以便在生产过程中实现更高效、更可靠的质量控制,具有较高的实际应用推广价值。     

面向分拣机器人的珍珠形状视觉检测方法

针对人工进行珍珠形状分拣效率低、精度不稳定等问题,提出基于机器视觉的珍珠形状检测方法;采用背光成像方式消除珍珠表面纹理和光泽的影响,对获取的珍珠图像进行同态滤波等预处理算法,提高图像对比度;为了解决相互接触珍珠影响珍珠轮廓提取的问题,采用分水岭算法对珍珠图像进行分割,得到了独立存在的珍珠个体,再通过连通域标记、质心算法对珍珠进行定位;根据国家标准对珍珠形状的规定,基于珍珠图像信息建立珍珠形状参数模型,对珍珠形状进行量化;实验结果表明,不同形状的珍珠样本的检测误差为0.63%,形状统计精度为100%,算法耗时24 ms;该方法可准确高效地对珍珠进行分拣分级,具有一定的实用价值。     

Rapid screening of DON contamination in whole wheat meals by Vis/NIR spectroscopy and computer vision coupling technology

This work intends to develop an online experimental system for screening of deoxynivalenol (DON) contamination in whole wheat meals by visible/near-infrared (Vis/NIR) spectroscopy and computer vision coupling technology. Spectral and image information of samples with various DON levels was collected at speed of 0.15 m s⁻¹ on a conveyor belt. The two-type data were then integrated and subjected to chemometric analysis. Discriminant analysis showed that samples could be classified by setting 1000 μg kg⁻¹ as the cut-off value. The best correct classified rate obtained in prediction was 93.55% based on fusion of spectral and image features, with reduced prediction uncertainty as compared to single feature. However, quantification of DON by quantitative analysis was not successful due to poor model performance. These results indicate that, although not accurate enough to provide conclusive result, this coupling technology could be adopted for rapid screening of DON contamination in cereals and feeds during processing.     

A double laser filtering approach to vibration noise rejection for hot-rolled strip flatness measurement

This paper proposes a new filtering method based on the Kalman filtering algorithm for hot-rolled strip flatness measurement system. The system involves processing slowly changing signal, which can be considered as a bounded random process, and its model parameters are completely unknown. The noise rejection strategy in double lasers can generate a compensation signal. Since the initial and accumulative error would lead to negative filter effect or even cause divergence, Kalman filter is integrated to effectively deal with the initial error and enhance convergence. In this setting, the noise rejection strategy is used as a prediction model to constitute a similar Kalman filter. The correlated error caused by measurement error is coped with by a compensation model based on the feature of correlated error to enhance the filter effect. Both theoretical analysis and simulations show that the new algorithm has a better filter effect than the traditional Kalman filtering algorithm for the system.     

Visually deficient working conditions and reduced work performance in office workers: Is it mediated by visual discomfort?

IntroductionThe main purpose of this cross-sectional study was to investigate whether visual discomfort acts as a mediating factor between perceived visual ergonomic working conditions and self-rated visual performance among office workers who carry out administrative tasks and computer-based work at the Swedish Tax Agency.MethodsA questionnaire was sent to 94 office workers addressing: 1) perceived visual quality of the visual display units; 2) prevalence of eye symptoms; and 3) self-rated visual performance. Eighty-six persons (54 women (63%), 31 men (36%), and 1 of unspecified sex) answered the questionnaire. Multiple regression analysis investigated the association between visual ergonomic working conditions and visual performance, both with and without visual discomfort as a mediator.ResultsThe group mean of the Indexed survey questions indicated a reasonably good quality of visual ergonomic working conditions, a relative absence of eye symptoms, and acceptable self-rated visual performance. Results from multiple regression analysis showed a significant association between perceived visual ergonomic working conditions and self-rated visual performance (r² = 0.30, β = 0.327, p < 0.01). When visual discomfort was used as a mediator, the association between perceived visual ergonomic working conditions and self-rated visual performance remained the same (r² = 0.32, β = 0.315, p < 0.01).DiscussionIt was remarkable to discover that self-rated visual performance was independent of visual discomfort. Possible explanations include exposure factors not included in the current study, such as dry air and sensory irritation in the eyes, psychosocial stress, time spent performing near work activities, or time exposed to visually deficient working conditions.Relevance to industryThe strong connection between satisfaction with visual ergonomic working conditions and productivity in this study has implications for workplace profitability and staff satisfaction. If productivity is enhanced by better visual ergonomic working conditions, then managers of workplaces may be able to improve work outcomes by optimizing the physical work environment.     

基于深度学习的四旋翼无人机单目视觉避障方法

针对无人机避障问题，提出一种基于深度学习的四旋翼无人机单目视觉避障方法。首先通过目标检测框选出目标在图像中的位置，并通过计算目标选框上下边距的长度，以此来估量出障碍物到无人机之间的距离；然后通过协同计算机判断是否执行避障动作；最后使用基于Pixhawk搭建的飞行实验平台进行实验。实验结果表明，该方法可用于无人机低速飞行条件下避障。该方法所用到的传感器只有一块单目摄像头，而且相对于传统的主动式传感器避障方法，所占用无人机的体积大幅减小。该方法鲁棒性较好，能够准确识别不同姿态的人，实现对人避障。     

虚拟手交互中约束类物体操作研究

虚拟手技术是虚拟现实技术中的一种交互方式，是指通过手势识别技术将人的真实手映射到虚拟环境中并与虚拟物体进行交互操作的人机交互方式。主要应用于虚拟训练、虚拟手术和虚拟装配等领域。对虚拟手交互的约束类对象进行了研究，提出了基于运动学的约束类物体操作方法，解决了阀门类有约束物体交互中虚拟手姿态不真实、操作不可控的问题。设计实验验证了基于运动学的方法能以符合实际操作的效果完成虚拟现实系统中的操作任务，可以应用到虚拟训练、虚拟装配等仿真平台。     

基于多视图立体视觉的沙堆三维尺寸测量研究

利用从运动中恢复结构方法(SFM),提出了一种基于多视图立体视觉的沙堆三维重建及三维尺寸测量方法。首先根据SFM方法的求解不稳定特点,结合光束平差法对SFM求解过程进行分析及优化;其次针对SFM重建结果为稀疏点云的问题,利用基于面片的稠密重建算法重新生成稠密的三维点云,再利用泊松算法对密集点云进行三维曲面重建;最后获得模型的三维尺寸信息。对某建筑工地的沙堆进行了三维尺寸的测量实验,实验结果验证了该方法的有效及可行性,提高了重建能力及精度,同时考虑了目标实际测量误差与重建误差,能够满足实际智能测量的应用需求。     

Learning a Deep Predictive Coding Network for a Semi-Supervised 3D-Hand Pose Estimation

In this paper we present a CNN based approach for a real time 3D-hand pose estimation from the depth sequence. Prior discriminative approaches have achieved remarkable success but are facing two main challenges: Firstly, the methods are fully supervised hence require large numbers of annotated training data to extract the dynamic information from a hand representation. Secondly, unreliable hand detectors based on strong assumptions or a weak detector which often fail in several situations like complex environment and multiple hands. In contrast to these methods, this paper presents an approach that can be considered as semi-supervised by performing predictive coding of image sequences of hand poses in order to capture latent features underlying a given image without supervision. The hand is modelled using a novel latent tree dependency model (LDTM) which transforms internal joint location to an explicit representation. Then the modeled hand topology is integrated with the pose estimator using data dependent method to jointly learn latent variables of the posterior pose appearance and the pose configuration respectively. Finally, an unsupervised error term which is a part of the recurrent architecture ensures smooth estimations of the final pose. Experiments on three challenging public datasets, ICVL, MSRA, and NYU demonstrate the significant performance of the proposed method which is comparable or better than state-of-the-art approaches.